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Abstract 

We consider the Moran process, as generalized by Lieberman, Hauert 
and Nowak {Nature, 433:312-316, 2005). A population resides on the 
vertices of a finite, connected, undirected graph and, at each time step, 
an individual is chosen at random with probability proportional to its 
assigned "fitness" value. It reproduces, placing a copy of itself on a 
neighbouring vertex chosen uniformly at random, replacing the individ- 
ual that was there. The initial population consists of a single mutant 
of fitness r > placed uniformly at random, with every other vertex 
occupied by an individual of fitness 1 . The main quantities of interest 
are the probabilities that the descendants of the initial mutant come 
to occupy the whole graph (fixation) and that they die out (extinc- 
tion); almost surely, these are the only possibilities. In general, exact 
computation of these quantities by standard Markov chain techniques 
requires solving a system of linear equations of size exponential in the 
order of the graph so is not feasible. We show that, with high prob- 
ability, the number of steps needed to reach fixation or extinction is 
bounded by a polynomial in the number of vertices in the graph. This 
bound allows us to construct fully polynomial randomized approxima- 
tion schemes (FPRAS) for the probability of fixation (when r ^ 1) and 
of extinction (for all r > 0). 
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1 Introduction 



Population and evolutionary dynamics have been extensively studied [2l[71 
[T6. 27,30-32j. usually with the assumption that the evolving population has 
no spatial structure. One of the main models in this area is the Moran 
process [23]. The initial population contains a single "mutant" with fitness 
r > 0, with all other individuals having fitness 1. At each step of the 
process, an individual is chosen at random, with probability proportional to 
its fitness. This individual reproduces, replacing a second individual, chosen 
uniformly at random, with a copy of itself. Population dynamics has also 
been studied in the context of strategic interaction in evolutionary game 
theory [TOllIMailH] . 

Lieberman, Hauert and Nowak introduced a generalization of the Moran 
process, where the members of the population are placed on the vertices of 
a connected graph which is, in general, directed jl9l|26j . In this model, the 
initial population again consists of a single mutant of fitness r > placed on 
a vertex chosen uniformly at random, with each other vertex occupied by a 
non- mutant with fitness 1. The individual that will reproduce is chosen as 
before but now one of its neighbours is randomly selected for replacement, 
either uniformly or according to a weighting of the edges. The original 
Moran process can be recovered by taking the graph to be an unweighted 
clique. In the present paper, we consider the process on finite, unweighted, 
undirected graphs. 

Several similar models describing particle interactions have been studied 
previously, including the SIR and SIS epidemic models [U Chapter 21], the 
voter model, the antivoter model and the exclusion process p^iHpO] . Related 
models, such as the decreasing cascade model [I8l|24], have been studied in 
the context of influence propagation in social networks and other models 
have been considered for dynamic monopolies [3]. However, these models 
do not consider different fitnesses for the individuals. 

In general, the Moran process on a connected, directed graph may end 
with all vertices occupied by mutants or with no vertex occupied by a mutant 
— these cases are referred to as fixation and extinction, respectively — or the 
process may continue forever. However, for undirected graphs and strongly- 
connected digraphs, the process terminates almost surely, either at fixation 
or extinction. (We consider only finite graphs.) At the other extreme, 
fixation is impossible in the directed graph with vertices {x, y, z} and edges 
{xi, yt} and extinction is impossible unless the mutant starts at z. The 
fixation probability for a mutant of fitness r in a graph G is the probability 
that fixation is reached and is denoted /c.r- 
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The fixation probability can be determined by standard Markov cliain 
techniques. However, doing so for a general graph on n vertices requires solv- 
ing a set of 2" linear equations, which is not computationally feasible. As a 
result, most prior work on computing fixation probabilities in the generalized 
Moran process has either been restricted to small graphs [7] or graph classes 
where a high degree of symmetry reduces the size of the set of equations 
— for example, paths, cycles, stars and cliques [H-E] — or has concentrated 
on finding graph classes that either encourage or suppress the spread of the 
mutants |19p22j. Rychtaf and Stadler present some experimental results on 
fixation probabilities for random graphs derived from grids [28]. 

Because of the apparent intractability of exact computation, we turn 
to approximation. Using a potential function argument, we show that, 
with high probability, the Moran process on an undirected graph of or- 
der n reaches absorption (either fixation or extinction) within 0{n^) steps 
if r = 1 and 0{n^) and 0{v?) steps when r > 1 and r < 1, respectively. 
Taylor et al. |31j studied absorption times for variants of the generalized 
Moran process but, in our setting, their results only apply to the process 
on regular graphs, where it is equivalent to a biased random walk on a line 
with absorbing barriers. The absorption time analysis of Broom et al. f3] is 
also restricted to cliques, cycles and stars. In contrast to this earlier work, 
our results apply to all connected undirected graphs. 

Our bound on the absorption time, along with polynomial upper and 
lower bounds for the fixation probability, allows the estimation of the fixation 
and extinction probabilities by Monte Carlo techniques. Specifically, we give 
a fully polynomial randomized approximation scheme (FPRAS) for these 
quantities. An FPRAS for a function f{X) is a polynomial-time randomized 
algorithm g that, given input X and an error bound e satisfies (1 — e)/(X) ^ 
g{X) ^ (1 + e)f{X) with probability at least | and runs in time polynomial 
in the length of X and \ p7] . 

For the case r < 1, there is no positive polynomial lower bound on the 
fixation probability so only the extinction probability can be approximated 
by this technique. (Note that, when / ^ 1, computing 1 — / to within a 
factor of 1 lb e does not imply computing / to within the same factor.) 

Notation. Throughout, we consider only finite, connected, undirected 
graphs G = (V^, -E) and we write n = |y| (the order of the graph). Our 
results apply only to connected graphs as, otherwise, the fixation probabil- 
ity is necessarily zero; we also exclude the one-vertex graph to avoid trivi- 
alities. The edge between vertices x and y is denoted by xy. For a subset 
X C V{G), we write X + y and X — y for X U {y} and X \ {y}, respectively. 
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Throughout, r denotes the fitness of the initially introduced mutant in 
the graph. Given a set X C we denote by W{X) = r\X\ + \V \X\ the 
total fitness of the population when exactly the vertices of X are occupied by 
mutants. We write fG,r{x) for the fixation probability of G, given that the 
initial mutant with fitness r was introduced at vertex x. We denote by = 
n X^xgv fG,r{x) the fixation probability of G; that is, the probability that 
a single mutant with fitness r placed uniformly at random in V eventually 
takes over the graph G. Finally, we define the problem MORAN fixation 
(respectively, MORAN extinction) as follows: given a graph G = {V,E) 
and a fitness value r > 0, compute the value fcr (respectively, 1 — fcr)- 

Organization of the paper. In Section [21 we demonstrate polynomial 
upper and lower bounds for the fixation probability fcr for an arbitrary 
undirected graph G. In Section [3l we use our potential function to derive 
polynomial bounds on the absorption time (both in expectation and with 
high probability) in general undirected graphs. Our FPRAS for computing 
fixation and extinction probabilities appears in Section HI 

2 Bounding the fixation probability 

Lieberman et al. observed that, if G is a directed graph with a single source 
(a vertex with in-degree zero) , then fc^r = ^ for any value of fitness r > of 
the initially introduced mutant [19] (see also \26\ p. 135]). In the following 
lemma we prove that fcr ^ ^ for every undirected graph, whenever r ^ 1. 

Lemma 1. Let G = {V,E) be an undirected graph with n vertices. Then 
fCr ^ ^ for any r ^ 1. 

Proof. Consider the variant of the process where every vertex starts with 
its own colour and every vertex has fitness 1. Allow the process to evolve as 
usual: at each step, a vertex is chosen uniformly at random and its colour is 
propagated to a neighbour also chosen uniformly at random. At any time, 
we can consider the vertices of any one colour to be the mutants and all the 
other vertices to be non-mutants. Hence, with probability 1, some colour 
will take over the graph and the probability that x's initial colour takes over 
is exactly /g,i(x). Thus, f^r ^ /g,i = ^ J2xeV fcA^) = ^ 

Note that there is no corresponding polynomial lower bound when r < 1. 
For example, for r ^ 1, the fixation probability of the clique Kn is given by 

1-i 

J K„,r — I ■ 
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For r > 1, this is at least 1 — ^ but there is no non-trivial polynomial lower 
bound where r < 1. 

Lemma 2. Let G = (V, E) he an undirected graph with n vertices. Then 
fG,r for any r > 0. 

Proof. For any vertex xEV, let Q{x) = Y.xy&E so Y.x€V Qi^) = ^• 

To give an upper bound for fa^rix) for every x G V, we relax the Markov 
chain by assuming that fixation is reached as soon as a second mutant is 
created. From the state S = {x}, the probability that a new mutant is 
created is a{x) = and the probability that one of x's non-mutant 

neighbours reproduces into x is b{x) = ^_^_^_^ Q(a:). The probability that 
the population stays the same, because a non-mutant reproduces to a non- 
mutant vertex, is \ — a{x)—b{x). The probability that the mutant population 
reaches two (i.e., that the first change to the state is the creation of a new 
mutant) is given by 

a{x) r 

p{x) = 



a{x) + b{x) r + Q{x) 
Therefore, the probability that the new process reaches fixation is 

x&V x&V ^ ' 

Writing p = Y17=i '^^ wish to find the maximum value subject 

to the constraints that Qi > for all i and Y17=i 1i ~ ^xeV Qi^) ~ 

relax the first constraint to qi ^ 0, the sum is maximized by setting qi = n 

and (/2 = ■ ■ ■ = = 0. Therefore, 

r / 1 1 \ 1 

fG,r^P^-(^ + {n-l)—r:)=l-^. □ 
n\r + n r + UJ r + n 

3 Bounding the absorption time 

In this section, we show that the Moran process on a connected graph G of 
order n is expected to reach absorption in a polynomial number of steps. To 
do this, we use the potential function given by 



4>{X) = 



degx 
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for any state X C V{G) and we write ^(G) for Note that 1 < 

0(G) ^ n and that, if (Xj)j^o is a Moran process on G then ^{Xq) = 
1/ degx ^ 1 for some vertex x €V (the initial mutant). 

First, we show that the potential strictly increases in expectation when 
r > 1 and strictly decreases in expectation when r < 1. 

Lemma 3. Let (Xj)j^o be a Moran process on a graph G = iy,E) and let 
C 5 C y. Ifr^l, then 

E[cP{Xi+i) - <j>{Xi) \ Xi = S]^ (l-l)-^, 



with equality if, and only if, r = 1. For r < 1, 

r-1 



E[(/.(X,+i) - 4>{Xi) \Xi = S]< 



n 
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Proof. Write W{S) = n + {r — 1)\S\ for the total fitness of the population. 

For ^ C S C V, and any value of r, we have 

E[0(Xi+i) - ^{Xi) \Xi = S] 

WiS) V ■ degx degy ) 

xeS,y€S 

1-^/1 1 1 1 



r • 



W{S) ^"^^ \ degy degx degx degy 

xes,yes 



- y ' ■ (1) 



W{S) degxdegy 

x&S,y&S 

This is clearly zero if r = 1. Otherwise, the sum is minimized in absolute 
value by noting that there must be at least one edge between S and S and 
that its endpoints have degree at most (n — 1) < n. The greatest-weight 
configuration is the one with all mutants if r > 1 and the one with no 
mutants if r < 1. Therefore, if r > 1, we have 

E[0(Xi+i) - (t>{Xi) \Xi = S] > ^ • ^ = f 1 - ^ 

rn n'^ \ r J 

and, if r < 1, 

E[0(X,+i) - 4>{Xi) \Xi = S] < {r-1)^. □ 
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The method of bounding in the above proof appears somewhat crude 
— for example, in a graph of order n > 2, if both endpoints of the chosen 
edge from S* to S* have degree n — 1 then there must be more edges between 
mutants and non-mutants. Nonetheless, over the class of all graphs, the 
bound of Lemma O is asymptotically optimal up to constant factors. For 
71 ^ 2, let Gn be the n- vertex graph made by adding an edge between the 
centres of two disjoint stars of as close-to-equal size as possible. If S is the 
vertex set of one of the stars, E[(/)(Xj+i) — 4>{Xi) \ Xi = S] = Q{n~^). 

However, it is possible to specialize equation ([T]) to give better bounds for 
restricted classes of graphs. For example, if we consider graphs of bounded 
degree then (degxdegy)"^ = 0{1) and the expected change in cj) is 0{^). 

To bound the expected absorption time, we use martingale techniques. It 
is well known how to bound the expected absorption time using a potential 
function that decreases in expectation until absorption. This has been made 
explicit by Hajek [IT] and we use following formulation based on that of He 
and Yao [12j . The proof is essentially theirs but modified to give a slightly 
stronger result. 

Theorem 4. Let (ii)i^o a Markov chain with state space Vt, where Yq 
is chosen from some set I Q ^1. If there are constants ki,k2 > and a 
non-negative function ^ : 17 ^ R such that 

• = for some 5 G fi, 

• il^{S) ^ ki for all S £ I and 

• E[2p{Yi)-iP{Yi+i) \Yi = S];^k2 for alli^Q and all S with ip{S) > 0, 
then E[r] ^ ki/k2, where r = min{i : ip{Yi) = 0}. 

Proof. By the third condition, the chain is a supermartingale so it converges 
to zero almost surely [25^ Theorem II-2-9]. 

E[i,{%) I ^(Yo) > 0] 

= E[E[V'(lJ-i) + - ^(^-i)) I Y,^i] I tP{Yo) > 0] 

^ E[^(lJ_i) - k2 I ^/J{Yo) > 0] . 

Induction on i gives E[ip{Yi) \ ip{Yo) > 0] ^ Hip{Yo) - ik2 \ > 0] and, 

from the definition of the stopping time r, 

= E[V(i;) I V'(^o) > 0] 

^ E[i;{Yo)] - A;2E[t | ^(^6) > 0] 
^ ki~ k2E[T I i^{Yo) > 0] . 
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The possibility that -0(56) = can only decrease the expected value of r 
since, in that case, r = 0. Therefore, E[t] ^ E[t | 0(15) > 0] ^ /ci//c2- □ 

Theorem 5. LetG = {V,E) be a graph of order n. Forr < 1, the absorption 
time T of the Moran process on G satisfies 

E[r] 

1 — r 

Proof. Let (i^)i>o be the process on G that behaves identically to the Moran 
process except that, if the mutants reach fixation, we introduce a new non- 
mutant on a vertex chosen uniformly at random. That is, from the state V, 
we move to V — x, where x is chosen u.a.r., instead of staying in V. Writing 
t' = min{i : 1^ = 0} for the absorption time of this new process, it is clear 
that E[r] ^ E[r']. 

The function (p meets the criteria for ip in the statement of Theorem |4] 
with ki = 1 and ^2 = {l — r)n~^. The first two conditions of the theorem are 
obviously satisfied. For S C V, the third condition is satisfied by Lemma [3] 
and we have 

E[0(y,) - cP{Yi+i) \Y, = V] = -y] >->k2. 

n ^-^ dee a; n 

x<^V 

Therefore, E[r] ^ E[r'] ^ ^n^. □ 

The following corollary is immediate from Markov's inequality. 

Corollary 6. The Moran process on G with fitness r < 1 reaches absorption 
within t steps with probability at least 1 — e, for any e G (0, 1) and any 

For r > 1, the proof needs slight adjustment because, in this case, (j) 
increases in expectation. 

Theorem 7. LetG = {V,E) be a graph of order n. Forr > 1, the absorption 
time T of the Moran process on G satisfies 

E[r] ^ — ^— n30(G) ^ — ^n^. 
r — 1 r — 1 

Proof. Let (li)j^o be the process that behaves identically to the Moran 
process (Xj)j^o except that, if the set of mutants is empty, a new mutant is 
created on a vertex chosen uniformly at random. Setting r' = min{i : Yi = 
V}, we have E[r] ^ E[r']. 
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Putting iP{S) = (p{G) - ^{S), h = (t){G) ^ n and fca = (1 - l)n-^ 
satisfies the conditions of Tfieorem [J] — tfie tliird condition follows from 
Lemma [3] for C 5 C F and 

n^{Yi) - i;{Y,+i) I = 0] = 1 V >->k2. 

n ^-^ deex n 

The result follows from Theorem HI □ 

Corollary 8. The Moran process on G with fitness r > 1 reaches absorption 
within t steps with probability at least \ — e, for any e S (0, 1) and any 
t > Th^^HG)/e. 

The 0{n'^) bound in Theorem [7] does not seem to be very tight and 
could, perhaps, be improved by a more careful analysis, which we leave for 
future work. In simulations, we have not found any class of graphs where 
the expected fixation time is Q(n^) for r > 1. The graphs G„ described 
after Lemma[3]are the slowest we have found but, even on those graphs, the 
absorption time is, empirically, still 0{n^). Note that n — 2 < 4){Gn) <n — \ 
so, for these graphs, even the bound of ;:^n,^(/>(Gn) is O(n^). 

The case r = 1 is more complicated as Lemma [3] shows that the ex- 
pectation is constant. However, this allows us to use standard martingale 
techniques and the proof of the following is partly adapted from the proof 
of Lemma 3.4 in [21] . 

To avoid cumbersome notation, we write </)q = - X]^gy(degx)^^. For 
the Moran process (Xj)j^o on G, this is E[(/)(Xo)^]. 

Theorem 9. The expected absorption time for the Moran process {Xi)i^Q 
with r = 1 on a graph G = (V,E) is at most n'^{<f){G)'^ — 0q). 

Proof. Let m = (j){G)/2 and let tpi = m — (f){Xi). Thus, —m ^ ^ m for 
ah i. By Lemma H E[0(Xi+i) | Xi] ^ (f>{Xi) so 

E[Vi+i I X,] ^ i;, . (2) 

(This inequality is, by Lemma [3l an equality but we do not need this.) 

From the definition of the process, ipi+i ^ V'« ifi ^iid only if, Xj+i ^ 
Xi. Therefore, r[ipi+i / tpi] = F[Xi+i / Xi] and, for < \Xi\ < n, this 
probability is at least n~'^ because there is at least one edge from a mutant to 
a non-mutant. From the definition of (j), if ipi+i V'i then — V'il ^ 

When \^i\ < m, it follows that 

E[(Vi+i - I X,] ^ . (3) 
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Let to = mm{t : \ipt\ = m}, which is a stopping time for the sequence 
(V'i)t^o and is also the least t for which Xt = $ or Xt = V. Let 

^ j '4^t ~ '^Tnipt — n~H if \ipt\ < m 
1 3m^ — n~Ho otherwise. 

We now show that (Zt)t^o is a submartingale. This is trivial for t ^ to, 
since then we have Zt+i = Zf. In the case where t < to, 

E[Zt+i - Zt I Xt] 

> E[ Vt+i - 2rmPt+i - n'^it + 1) - V? + ^rmPt + n'^t | Xt] 
= E[-2m(Vt+i - Vt) + i^t+i - V't - \ Xt] 
= E[2(Vt - m)ii^t+i - ^t) + {^t+i - ^tf - n-^ \ Xt] 
^ 0. 

The first inequality is because 3m? ipt — 2m'ipt for all t, since \ipt\ ^ 
m. The final inequality comes from equations ^ and Note also that 
E[Zt+i — Zt I Xt] ^ dm? < oo in all cases. 
We have 

K[Zo] = E[(m - <P{Xo) f - 2m(m - (/.(Xq))] 
= E[0(Xo)2 - m^] 

and EfZfp] = 3m^ — n^^E[to]. io is a stopping time for {Zt)t^o as it is the first 
time at which Zt = 3m^ — n~H. Therefore, the optional stopping theorem 
says that E[Ztf,] ^ E[Zo], as long as E[to] < oo, which we will show in a 
moment. It follows, then, that 

3m2-n~^E[to] ^^Q-m^, 

which gives 

E[to] < n\Am^ - 0^,) = n\ct^{Gf - <P'^) , 

as required. 

It remains to establish that has finite expectation. Consider a block 
of n successive stages X^-, ■ ■ ■ , Xk+n-i- If the Moran process has not already 
reached absorption by X^, then ^ 1. Consider any sequence of repro- 
ductions by which a single mutant in X/^ could spread through the whole 
graph. Each transition in that sequence has probability at least n"^ so the 
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sequence has probability at least p = (n~^)" and, therefore, the probability 
of absorption within the block is at least this value. But then the expected 
number of blocks before absorption is at most 



and, therefore, E[to] < cxd as required. □ 

Corollary 10. (i) The expected absorption time for the Moran process with 
r = 1 on any graph is at most t = ^(G)^n^. (ii) For any e G (0,1), the 
process reaches absorption within t/e steps with probability at least 1 — e. 

Proof. The first part is immediate from the previous theorem and the fact 
that (f)Q > 0. The second part follows by Markov's inequality. □ 



4 Approximation algorithms 

We now have all the components needed to present our fully polynomial 

randomized approximation schemes (FPRAS) for the problem of computing 
the fixation probability of a graph, where r ^ 1, and for computing the 
extinction probability for all r > 0. Recall that an FPRAS for a function / 
is a randomized algorithm g that, given input X, gives an output satisfying 

{l-e)f{X)^g{X)^{l + e)f{X) 

with probability at least | and has running time polynomial in both \X\ 
and i. In both of the following theorems, we require that r be encoded in 
unary, to ensure that N is bounded by a polynomial in the size of the input. 

Theorem 11. There is an FPRAS for Moran fixation, forr ^ 1. 

Proof. The algorithm is to simulate the Moran process on G for some num- 
ber T of steps (to be defined shortly), = [^e~^n^ In 16] times and compute 
the proportion of simulations that reached fixation. If any simulation has 
not reached absorption (fixation or extinction) after T steps, we abort and 
immediately return an error value. For r > 1, let T = \^Nn'^] and, for 
r = 1, let T = 8Nn^. 

Note that each transition of the Moran process can be simulated in 0(1) 
time. Maintaining lists of the mutant and non-mutant vertices allows the 
reproducing vertex to be chosen in constant time and storing a list of each 
vertex's neighbours allows the same for the vertex where the offspring is sent. 
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Therefore, the total running time is 0{NT) steps, which is polynomial in n 
and as required. 

It remains to show that the algorithm operates within the required error 
bounds. For i G {1, . . . , A^}, let Xi = 1 \i the rth simulation of the Moran 
process reaches fixation and Xj = otherwise. Assuming all simulation 
runs reach absorption, the output of the algorithm is p = jjYlii-^i- 
Hoeff ding's inequality and writing / = we have 

IP[b - /I > e/] ^ 2 e^^{-2e^fN) = 2 e-x.^{-2fn'^ In 16) ^ i , 

where the second inequality is because, by Lemma [H / ^ ^• 

Now, the probability that any individual simulation has not reached ab- 
sorption after T steps is at most by Corollary [8] for r > 1 and Corollary [TO] 
for r = 1. Taking a union bound, the probability of aborting and return- 
ing an error because at least one of the simulations was cut off before 
reaching absorption is at most |. Therefore, with probability at least |, the 
algorithm returns a value within a factor of e of fcr- D 

Note that this technique fails for disadvantageous mutants (r < 1) be- 
cause there is no analogue of Lemma [T] giving a polynomial lower bound on 
fCr- As such, an exponential number of simulations may be required to 
achieve the desired error probability. However, we can give an FPRAS for 
the extinction probability for all r > 0. Although the extinction probability 
is just 1 — /cr; there is no contradiction because a small relative error in 
1 ~ /c.r does not translate into a small relative error in f^r when f^r is, 
itself, small. 

Theorem 12. There is an FPRAS for Moran extinction for all r > 0. 

Proof. The algorithm is as above but taking N = [|e~^(r -|- n)^lnl6] and 
T = \j^Nn^~\ for r < 1; we keep T as the same multiples of as before 
for r ^ 1. The proof proceeds as before but using Lemma [2] to show that 
the extinction probability is at least (r + n)~^ and Corollary [6] to bound the 
probability that a run is truncated when r < 1. □ 

It remains open whether other techniques could lead to an FPRAS for 
Moran fixation when r < 1. 
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